A New Distance-weighted k-nearest Neighbor Classifier
نویسندگان
چکیده
In this paper, we develop a novel Distance-weighted k -nearest Neighbor rule (DWKNN), using the dual distance-weighted function. The proposed DWKNN is motivated by the sensitivity problem of the selection of the neighborhood size k that exists in k -nearest Neighbor rule (KNN), with the aim of improving classification performance. The experiment results on twelve real data sets demonstrate that our proposed classifier is robust to different choices of k to some degree, and yields good performance with a larger optimal k, compared to the other state-of-art KNN-based methods.
منابع مشابه
Ideal bootstrap estimation of expected prediction error for k-nearest neighbor classifiers: Applications for classification and error assessment
Euclidean distance -nearest neighbor ( -NN) classifiers are simple nonparametric classification rules. 5 5 Bootstrap methods, widely used for estimating the expected prediction error of classification rules, are motivated by the objective of calculating the ideal bootstrap estimate of expected prediction error. In practice, bootstrap methods use Monte Carlo resampling to estimate the ideal boot...
متن کاملComparison of Distance Metrics for Phoneme Classification based on Deep Neural Network Features and Weighted k-NN Classifier
K-nearest neighbor (k-NN) classification is a powerful and simple method for classification. k-NN classifiers approximate a Bayesian classifier for a large number of data samples. The accuracy of k-NN classifier relies on the distance metric used for calculating nearest neighbor and features used for instances in training and testing data. In this paper we use deep neural networks (DNNs) as a f...
متن کاملMulti-hypothesis nearest-neighbor classifier based on class-conditional weighted distance metric
The performance of nearest-neighbor (NN) classifiers is known to be very sensitive to the distance metric used in classifying a query pattern, especially in scarce-prototype cases. In this paper, a classconditional weighted (CCW) distance metric related to both the class labels of the prototypes and the query patterns is proposed. Compared with the existing distance metrics, the proposed metric...
متن کاملImpact of the Sakoe-Chiba Band on the DTW Time Series Distance Measure for kNN Classification
For classification of time series, the simple 1-nearest neighbor (1NN) classifier in combination with an elastic distance measure such as Dynamic Time Warping (DTW) distance is considered superior in terms of classification accuracy to many other more elaborate methods, including k-nearest neighbor (kNN) with neighborhood size k > 1. In this paper we revisit this apparently peculiar relationshi...
متن کاملA New Hybrid Audio Classification Algorithm Based on SVM Weight Factor and Euclidean Distance
The text-based classification dominates in the conventional audio classification systems, in which tedious manual work is used to notate the name, class, or sample rate. However, on most occasions, this method is not satisfying due to its opaque to real content. In order to retrieve the audio files effectively and efficiently, content-based audio classification becomes more and more necessary. ...
متن کامل